Multisensory Perceptual Discrimination in Evolved Networks and Agents
نویسنده
چکیده
The fact that humans and animals have several sensory modalities and use them together to make sense of the world imbues their behaviour with an immense richness and robustness. In this study, recurrent neural networks and minimal agents with active vision are evolved for a perceptual discrimination task (unimodal and bimodal). The purpose of this study is mainly exploratory: to test which of the characteristics of human perceptual discrimination evolve easily (with a focus on statistically optimal integration), how they are realised and what active perception does in this process. Whilst some of the systems evolved to perform perceptual discrimination well, they did not conform to the predictions from statistical optimality. Analyses of the systems point towards a number of relevant issues, noticeably towards the lack of a good account of ‘unimodality’ in existing models of multisensory perception.
منابع مشابه
Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations
Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific process...
متن کاملBenefits of multisensory learning.
Studies of learning, and in particular perceptual learning, have focused on learning of stimuli consisting of a single sensory modality. However, our experience in the world involves constant multisensory stimulation. For instance, visual and auditory information are integrated in performing many tasks that involve localizing and tracking moving objects. Therefore, it is likely that the human b...
متن کاملThe role of multisensory memories in unisensory object discrimination.
Past multisensory experiences can influence current unisensory processing and memory performance. Repeated images are better discriminated if initially presented as auditory-visual pairs, rather than only visually. An experience's context thus plays a role in how well repetitions of certain aspects are later recognized. Here, we investigated factors during the initial multisensory experience th...
متن کاملThe Ontogeny of Human Multisensory Object Perception: A Constructivist Account
Our perceptual world is multisensory in nature (J. J. Gibson, 1966; Marks, 1978; Stein and Meredith, 1993; Werner, 1973). This means that the objects in our natural world are usually specified by some combination of visual, auditory, tactile, olfactory, and gustatory attributes. From a theoretical perspective, it is possible that the mélange of multisensory object attributes might be confusing....
متن کاملVisual adaptation enhances action sound discrimination
Prolonged exposure, or adaptation, to a stimulus in 1 modality can bias, but also enhance, perception of a subsequent stimulus presented within the same modality. However, recent research has also found that adaptation in 1 modality can bias perception in another modality. Here, we show a novel crossmodal adaptation effect, where adaptation to a visual stimulus enhances subsequent auditory perc...
متن کامل